Action and valence modulate choice and choice-induced preference change.

Choices are not only communicated via explicit actions but also passively through inaction. In this study we investigated how active or passive choice impacts upon the choice process itself as well as a preference change induced by choice. Subjects were tasked to select a preference for unfamiliar photographs by action or inaction, before and after they gave valuation ratings for all photographs. We replicate a finding that valuation increases for chosen items and decreases for unchosen items compared to a control condition in which the choice was made post re-evaluation. Whether choice was expressed actively or passively affected the dynamics of revaluation differently for positive and negatively valenced items. Additionally, the choice itself was biased towards action such that subjects tended to choose a photograph obtained by action more often than a photographed obtained through inaction. These results highlight intrinsic biases consistent with a tight coupling of action and reward and add to an emerging understanding of how the mode of action itself, and not just an associated outcome, modulates the decision making process

Deep and superficial amygdala nuclei projections revealed in vivo by probabilistic tractography

Copyright © 2011 Society for Neuroscience and the authors. The The Journal of Neuroscience uses a Creative Commons Attribution-NonCommercial-ShareAlike licence: http://creativecommons.org/licenses/by-nc-sa/4.0/.Despite a homogenous macroscopic appearance on magnetic resonance images, subregions of the amygdala express distinct functional profiles as well as corresponding differences in connectivity. In particular, histological analysis shows stronger connections for superficial (i.e., centromedial and cortical), compared with deep (i.e., basolateral and other), amygdala nuclei to lateral orbitofrontal cortex and stronger connections of deep compared with superficial, nuclei to polymodal areas in the temporal pole. Here, we use diffusion weighted imaging with probabilistic tractography to investigate these connections in humans. We use a data-driven approach to segment the amygdala into two subregions using k-means clustering. The identified subregions are spatially contiguous and their location corresponds to deep and superficial nuclear groups. Quantification of the connection strength between these amygdala clusters and individual target regions corresponds to qualitative histological findings in non-human primates, indicating such findings can be extrapolated to humans. We propose that connectivity profiles provide a potentially powerful approach for in vivo amygdala parcellation and can serve as a guide in studies that exploit functional and anatomical neuroimaging.The Wellcome Trust, a Max Planck Research Award and Swiss National Science Foundation

How People Use Social Information to Find out What to Want in the Paradigmatic Case of Inter-temporal Preferences.

The weight with which a specific outcome feature contributes to preference quantifies a person's 'taste' for that feature. However, far from being fixed personality characteristics, tastes are plastic. They tend to align, for example, with those of others even if such conformity is not rewarded. We hypothesised that people can be uncertain about their tastes. Personal tastes are therefore uncertain beliefs. People can thus learn about them by considering evidence, such as the preferences of relevant others, and then performing Bayesian updating. If a person's choice variability reflects uncertainty, as in random-preference models, then a signature of Bayesian updating is that the degree of taste change should correlate with that person's choice variability. Temporal discounting coefficients are an important example of taste-for patience. These coefficients quantify impulsivity, have good psychometric properties and can change upon observing others' choices. We examined discounting preferences in a novel, large community study of 14-24 year olds. We assessed discounting behaviour, including decision variability, before and after participants observed another person's choices. We found good evidence for taste uncertainty and for Bayesian taste updating. First, participants displayed decision variability which was better accounted for by a random-taste than by a response-noise model. Second, apparent taste shifts were well described by a Bayesian model taking into account taste uncertainty and the relevance of social information. Our findings have important neuroscientific, clinical and developmental significance

A Stable Sparse Fear Memory Trace in Human Amygdala

Pavlovian fear conditioning is highly conserved across species, providing a powerful model of aversive learning. In rodents, fear memory is stored and reactivated under the influence of the amygdala. There is no evidence for an equivalent mechanism in primates, and an opposite mechanism is proposed whereby primate amygdala contributes only to an initial phase of aversive learning, subsequently ceding fear memory to extra-amygdalar regions. Here, we reexamine this question by exploiting human high-resolution functional magnetic resonance imaging in conjunction with multivariate methods. By assuming a sparse neural coding, we show it is possible, at an individual subject level, to discriminate responses to conditioned (CS+ and CS-) stimuli in both basolateral and centro-cortical amygdala nuclei. The strength of this discrimination increased over time and was tightly coupled to the behavioral expression of fear, consistent with an expression of a stable fear memory trace. These data highlight that the human basolateral and centro-cortical amygdala support initial learning as well more enduring fear memory storage. A sparse neuronal representation for fear, here revealed by multivariate pattern classification, resolves why an enduring memory trace has proven elusive in previous human studies

Encoding of Marginal Utility across Time in the Human Brain

Marginal utility theory prescribes the relationship between the objective property of the magnitude of rewards and their subjective value. Despite its pervasive influence, however, there is remarkably little direct empirical evidence for such a theory of value, let alone of its neurobiological basis. We show that human preferences in an intertemporal choice task are best described by a model that integrates marginally diminishing utility with temporal discounting. Using functional magnetic resonance imaging, we show that activity in the dorsal striatum encodes both the marginal utility of rewards, over and above that which can be described by their magnitude alone, and the discounting associated with increasing time. In addition, our data show that dorsal striatum may be involved in integrating subjective valuation systems inherent to time and magnitude, thereby providing an overall metric of value used to guide choice behavior. Furthermore, during choice, we show that anterior cingulate activity correlates with the degree of difficulty associated with dissonance between value and time. Our data support an integrative architecture for decision making, revealing the neural representation of distinct subcomponents of value that may contribute to impulsivity and decisiveness

Disrupted state transition learning as a computational marker of compulsivity

Background: Disorders involving compulsivity, fear, and anxiety are linked to beliefs that the world is less predictable. We lack a mechanistic explanation for how such beliefs arise. Here, we test a hypothesis that in people with compulsivity, fear, and anxiety, learning a probabilistic mapping between actions and environmental states is compromised. // Methods: In Study 1 (n = 174), we designed a novel online task that isolated state transition learning from other facets of learning and planning. To determine whether this impairment is due to learning that is too fast or too slow, we estimated state transition learning rates by fitting computational models to two independent datasets, which tested learning in environments in which state transitions were either stable (Study 2: n = 1413) or changing (Study 3: n = 192). // Results: Study 1 established that individuals with higher levels of compulsivity are more likely to demonstrate an impairment in state transition learning. Preliminary evidence here linked this impairment to a common factor comprising compulsivity and fear. Studies 2 and 3 showed that compulsivity is associated with learning that is too fast when it should be slow (i.e. when state transition are stable) and too slow when it should be fast (i.e. when state transitions change). // Conclusions: Together, these findings indicate that compulsivity is associated with a dysregulation of state transition learning, wherein the rate of learning is not well adapted to the task environment. Thus, dysregulated state transition learning might provide a key target for therapeutic intervention in compulsivity

Improving the reliability of model-based decision-making estimates in the two-stage decision task with reaction-times and drift-diffusion modeling

A well-established notion in cognitive neuroscience proposes that multiple brain systems contribute to choice behaviour. These include: (1) a model-free system that uses values cached from the outcome history of alternative actions, and (2) a model-based system that considers action outcomes and the transition structure of the environment. The widespread use of this distinction, across a range of applications, renders it important to index their distinct influences with high reliability. Here we consider the two-stage task, widely considered as a gold standard measure for the contribution of model-based and model-free systems to human choice. We tested the internal/temporal stability of measures from this task, including those estimated via an established computational model, as well as an extended model using drift-diffusion. Drift-diffusion modeling suggested that both choice in the first stage, and RTs in the second stage, are directly affected by a model-based/free trade-off parameter. Both parameter recovery and the stability of model-based estimates were poor but improved substantially when both choice and RT were used (compared to choice only), and when more trials (than conventionally used in research practice) were included in our analysis. The findings have implications for interpretation of past and future studies based on the use of the two-stage task, as well as for characterising the contribution of model-based processes to choice behaviour

Parcellation of the human substantia nigra based on anatomical connectivity to the striatum

Substantia nigra/ventral tegmental area (SN/VTA) subregions, defined by dopaminergic projections to the striatum, are differentially affected by health (e.g. normal aging) and disease (e.g. Parkinson's disease). This may have an impact on reward processing which relies on dopaminergic regions and circuits. We acquired diffusion tensor imaging (DTI) with probabilistic tractography in 30 healthy older adults to determine whether subregions of the SN/VTA could be delineated based on anatomical connectivity to the striatum. We found that a dorsomedial region of the SN/VTA preferentially connected to the ventral striatum whereas a more ventrolateral region connected to the dorsal striatum. These SN/VTA subregions could be characterised by differences in quantitative structural imaging parameters, suggesting different underlying tissue properties. We also observed that these connectivity patterns differentially mapped onto reward dependence personality trait. We show that tractography can be used to parcellate the SN/VTA into anatomically plausible and behaviourally meaningful compartments, an approach that may help future studies to provide a more fine-grained synopsis of pathological changes in the dopaminergic midbrain and their functional impact